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Abstract 

Let v £ M 1 ([0,oo[) be a fixed probability measure. For each dimension p £ N, 
let (XP) n >i be i.i.d. Revalued random variables with radially symmetric distributions 
and radial distribution v. We investigate the distribution of the Euclidean length of 
S% := Xf + . . . + XP for large parameters n and p. Depending on the growth of the 
dimension p = p n we derive by the method of moments two complementary CLT's for 
the functional HS^I^ with normal limits, namely for n/p n —> oo and n/p n — > 0. Moreover, 
we present a CLT for the case n/p n — > c e]0,oo[. Thereby we derive explicit formulas 
and asymptotic results for moments of radial distributed random variables on R p . 

All limit theorems are considered also for orthogonal invariant random walks on the 
space M p q (R) of p x q matrices instead of R p for p — > oo and some fixed dimension q. 

1 Introduction 

The results in this paper are motivated by the following problem: Let v S M^QO, oof) be 
a fixed probability measure. Then for each dimension p £ N there is a unique rotation 
invariant probability measure u p £ M 4 (R P ) with ipp(v p ) = v, where <p p (x) := [|a?[| 2 is the 
norm mapping. For each p£N consider i.i.d. Revalued random variables X?, k £ N, with 
law Up as well as the associated radial random walks 



(Si := E X l 



k=l 



n>0 



on R p . We are interested in finding central limit theorems for the [0, oo[- valued random 
variables HS^I^ for n,p — > oo coupled in a suitable way. In this paper we derive the following 
two associated central limit theorems under disjoint growth conditions for p = p n . 

Theorem 1.1. Assume thatu £ ^f 1 ([0,oo[) admits finite moments rkiy) '■= Jq° x k dv(x) < oo 
for k < 4. Let (p n ) n be a sequence of dimensions with lim n _ ! . 00 p n = oo. 



(1) If lim — = oo, then 

1 7 J n->oo Pn 



n 

Y2\ 



tends in distribution for n — > oo to the normal distribution 7y(0, Iriiy) 
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(2) If lim = c G [0,oof, then 



1 , |2 



v77 J5M|^-nr 2 (z,)) 

tends in distribution for n — > oo to the normal distribution iy(0, r±(y) — (1 — 2c)r2{v) 2 ). 

Parts of this theorem were derived in [13J by using completely different methods. More 
precisely, CLT's above were proven for sequences (p n ) n with some strong restriction. The first 
CLT with the restriction njp\ — > oo, was identified by M. Voit as an obvious consequence of 
Berry-Esseen estimates on R p with explicit constants depending on the dimension p, which 
are due to Bentkus and Gotze [H [2J. The proof of the second CLT with the restriction 
n 2 /p n — > 0, was derived in [T3] as a consequence of asymptotic properties of so called Bessel 
convolutions (for a survey about the Bessel convolutions we recommend [S]). 

With the approach used in [T3] one is not able to get rid of the strong conditions on the 
growth of p = p n . In particular, the mixed case p n = c-n for some constant c, which builds a 
bridge between the CLT's with n « p n and n» p n was stated there as an open problem. 

Other associated limit theorems as laws of large numbers and large deviation principle 
were studied in [10] . For example, there was proven that 



1 r°° 

- \\Sn"\\l — »• / x 2 du(x) P - a.s. 
n Jo 



under the condition that p n grows fast enough. 

Theorem 11.11 will appear as special case of an extension which concerns a matrix- valued 
version. We consider the following geometric situation: For p, q G N we will denote by M- pg 
the space of p x g-matrices over the field of real numbers R. Let further H be the space of 
symmetric q x (/-matrices. Moreover, we will denote by 11^ the cone of positive semidefinite 
q x q matrices in We regard M as a real vector space of dimension pq, equipped with 
the Euclidean scalar product (x,y) := tr(x'y) and norm ||x|| = \Jtr{x'x) where x' is the 
transpose of x and tr is the trace in M q := M qq . In the square case p = q, \\-\\ is just the 
Frobenius norm. The orthogonal group O p acts on M- P>q by left multiplication, 

O p x M p q -»• M p ? , (A, x) ^ Ax. (1.1) 

By uniqueness of the polar decomposition, two matrices x, y G M. pq belong to the same 

Op-orbit if and only if x'x = y'y. Thus the space Mp^ of O p -orbits in M pq is naturally 
parameterized by the cone H q via the map 



x®p i y ^fxfx -. \x\ , m£t n g , 



where for r£ll g) the matrix yjr G Il g denotes the unique positive semidefinite square root 
of r. According to this, the map 

ip p : Mp, g ->■ n ? , x H> Vx^x 
will be regarded as the canonical projection M p q — > M p ~g . 
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In the case q = 1 we have M p l = R p , = R, IIi = [0, oof and (p p is the usual norm 
mapping ||-|| 2 : R p —> [0, oof. Let us now fix a parameter g£N. By taking images of measures, 

ip p induces a Banach space isomorphism between the space M b ~ p (M p(J ) of all bounded radial 
(i.e. Op invariant) Borel measures on M p iJ and the space M b (II g ) of bounded Borel measures 
on the cone Tl q . In particular, for each measure v G M^ILj) and parameter p there is a 
unique radial probability measure v p := u Ptq G M (M„ 9 ) with <p p (v p ) = v. 

Let v G I\I 1 (n g ) be a fixed probability measure and q G N. As in the case q = 1, we now 
consider for each "dimension" p G N the associated radial measures v v on M p g and the radial 
random walks (S? := X)fc=i^£) n >o> i- e - -^fc> A: G N are independent z/p-distributed random 
variables. 

With this notations, we shall derive the following generalization of Theorem ll.il 

Theorem 1.2. Assume that v G ^(Ilq) with J n<j ||s|| 4 di^(s) < oo. Let (Pn) ng _/v a sequence 
of dimensions with lim n _ 5 . 00 p ra = oo. 

(1) If lim — = oo, then the Tl n -valued random variable 



n 



■(/ Pn {S P n)-nf s 2 du(s)) 



tends in distribution to some normal distribution iy(0,T 2 (v)) on the vector space M q 
with some covariance matrix T 2 (u), wich will be described in Theorem VS. 1\ precisely. 

(2) If lim — = c G fO, oof, then the Yl n -valued random variable 



tends in distribution to the normal distribution jy(0, T, 2 (v) + cT 2 (v)) on the vector space 
M q where X 2 (V) is the covariance matrix of the H q -valued random variable (f Pn (Xf n ). 
Note that T, 2 (y) depends only on v and is independent of p n . 

We shall derive Theorem 11.21 in this higher rank setting in Section EJ The proof will rely 
on asymptotic results for moment functions of so called radial distributed random variables 
on M q for p — > oo as well as on some identities for matrix variate normal distributions. 

The organization of the paper is a follows: In section [21 some preliminaries for the proof 
of the main result [TT21 are presented. More precisely, in Subsection 12. 1\ after recalling some 
basic facts about relevant matrix algebra we derive a generalization of so called permutation 
equivalence property for Kronecker products. In 12.21 we generalize the multinomial theorem 
for non commutative operations. In Subsection 12.31 background on Bessel functions on the 
cone H q is provided. Subsections I2.4H2.6I are devoted to the study on the moments of radial 
measures and of matrix variate normal distributions respectively. In Section our main 
result is formulated and proved. 



2 Preliminaries 

2.1 Kronecker and Hadamard products 

In this section we collect some known facts about Kronecker and Hadamard products. The 
material is taken from [7]. 
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Let ® denotes the Kronecker product over the field of real numbers R, that is, 8> is an 
operation on two matrices of arbitrary size over R resulting in a block matrix. It gives the 
matrix of the tensor product with respect to a standard choice of basis. With that the 
Kronecker product of A = [a^] E M m n and B = [by] E M Pt q is the block matrix 

A®B:= [a tj B] E M mp ^ nq . 

The Kronecker product is bilinear and associative but not commutative. However, A ® B 
and B® A are permutation equivalent, meaning that there exist permutation matrices P and 
Q such that 

A®B = P-(B®A)-Q. (2.1) 

If A and 5 are square matrices, then A®B and B®A are even permutation similar, meaning 
that we can take P = Q' . If A, B, C and D are matrices of such size that one can form the 
matrix products A ■ C and B ■ D, then 

(A® B) ■ (C® £>) = A- C® B ■ D. (2.2) 

This is called the mixed-product property, because it mixes the ordinary matrix product and 
the Kronecker product. If two matrices P and Q are permutation, orthogonal or positive 
definite matrices then so is also the Kronecker product P <g> Q. 

The k-th Kronecker power A® k is defined inductively for all positive integers k by 

A® 1 = A and A® k = A <g> A^ k ~^ for k = 2, 3, ... . 

This definition implies that for A E M TOn , we have ^4® fc E M m fe n k. 
For a matrix X E M m n , vec(X) is the m ■ n x 1 vector defined as 

uec(X) = {x[, . . .,x' m )' E M m . n l , 

where Xi, i = 1, . . . , n is the i-th column of X. 

We now derive a generalization of permutation equivalence property, which will be re- 
quired for the proof of Theorem 13.11 below. 

Lemma 2.1. Let A% E M p . „. (i = 1, . . . , k), p := p\ ■ . . . • pt and q := q% ■ . . . ■ qk- Then, 
for each permutation a E Sym({l, . . . , k}) there exist permutation matrices P a E M pp and 
Q a E M q q such that 

A a(1) (8) ... (8) A a{k) =P a -(Ax®...® A k ) ■ Q a . 

Proof. Without loss of generality we can assume that k = 4, for the Kronecker product is 
associative. Since (1) (g> M = M = M (g> (1) for any matrices M, it suffices to show that 
A\ (8> A3 ® A2 ® A4 is permutation equivalent to A% <S> A2 ® ^3 ® -A4. For a matrix M let 
/m an d I M denote the identity matrices of such size that one can form the matrix products 
Im • M and M • I . By the property (|2.1|) there exist permutation matrices P and Q with 
A3 <g) ^2 = -P(^2 "8 1 ^3)Q- Therefore, using (|2.2|) we obtain by an easy computation 

A x (8) ^3 ® M ® A 4 = (I Al ®P® I Ai ) • [A x ®A 2 ®A 3 (g> A A ) ■ (l Al ® Q <g> I^ 4 ) . 
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Clearly, both Ia x <8> P <8> Ia 4 and I" 41 Q ® I Ai are permutation matrices. This completes 
the proof. □ 



In the following, let A = [(%•], B = [bij] E M„ 9 of the same dimensions. The Hadamard 
product, also known as the entrywise product of A and B is denoted by A o B and is defined 
to be the matrix 

A o B := [aijby] E M p g . 

The Hadamard product is commutative, associative and distributive w.r.t. addition, and is 
a principal submatrix of the Kronecker product. 

For a matrix M , let us denote by 1m the 1-matrix of the same dimension as M, that is, 
fl-M = ( c ij)ij with Cjj = 1 for all We will write it simply 1 when no confusion will arise. 
It is clear that 

A®B = (A® i)o (i<g>£), (2.3) 
S®i4=(i®A)o(J3®l). (2.4) 

Let P and Q be permutation matrices of such size that one can form the matrix products 
P ■ A and A ■ Q. It is easy to check that 

P(AoB)Q = (PAQ)o(PBQ). (2.5) 



2.2 Permutations on a multiset 

In this section, we generalize the multinomial theorem in terms of Kronecker product instead 
of the usual multiplication. In order to do this, we first recall the notion of the permutation 
on a multiset from Chapter 1]. 

Let u E N and k E N . We denote by Co(k,u) the set of all u-compositions of k, that is, 



u 

C (k,u) = {\£^: \X\ :=Y / ^ = k}, 



i=l 

and write C(k,u) instead of Co(k,u) flN". Moreover, we set M u := {1,2, ... ,u}. For a 
A E C(k, u) a finite multiset Mult(X) on the ordered set M u is a is a set, where i is contained 
with the multiplicity Aj for all i E M u . One regards Aj as the number of repetitions of i. A 
permutation it = (ttitt2 ■ ■ ■ vr^) on Mult(X) can be defined as a linear ordering of the elements 
of Mult(X), that is, an element i E M appears exactly Aj times in the permutation ir. The 
set of all permutation on Mult(X) will be denoted by ©(A). A permutation ir = {1T1IT2 • • • ^k) 
on Mult(X; M) can be regarded as a way to place k distinguishable balls in u distinguishable 
boxes such that the i-th box contains Aj balls. Indeed, if i (i = 1, . . . ,u) appears in position 
j E {1, . . . , k} of the permutation ir, then we put the "ball" ttj into the box i. For instance 
let u = 3, A := (1,3,2) E C{k,u) be a 3-composition of k = 6 and tt = (2 1 2 3 3 2) =: 
("7Ti 7T2 . . . ire) be a permutation on Mult(X) then we put iT2 in the first box, tti,tt^,ttq in the 
second box and ^4,-^5 in the third box. It is clear that 



l©(A)| 




kl 

Ai!...A u ! - 



5 



Let rrii G M- Piqi (i = 1, . . . ,u), X £ C(k,u) and ir = (tti, . . . , 7Tfe) G ©(A). We will write 
7r(mi, . . . , m u ) instead of m ni (g) m 7r2 (g) • • • g) m,,-,.. Moreover, we set 

W(n, u) := {fj, = (fn, . . . , fi u ) G {1, . . . , n} M : /ii < fi 2 < ■ ■ ■ < fi u } ■ 

In the following theorem, which will be used in Section [3]several times, we expand a Kronecker 
power of a matrix sum in terms of powers of the terms in that sum. 

Theorem 2.2. Let k £ N and x%, . . . , x n G M pq . Then 

n „ k 

(E 3 *) ' =E E E E vr^,...^^). (2.6) 

i=l W=l AeC*(fc,u) /iSW(n,u) 7re6(A) 

For p = q = 1 the Kronecker product coincides with the usual multiplication on R 
and therefore, (|2.6[) generalizes multinomial formula. For indices u G {l,...,k}, fx = 
(fix, ■ ■ ■ , /%) G W(n,u), A G C(k,u) and ir G ©(A) let us consider the associated summand 

TT^,...,^) = X^ ®...®2^ (2.7) 

from (|2.6p . It is clear that the different matrices x^ , ■ ■ ■ , x^ u , the numbers of their repetitions 
and their exact positions in the Kronecker product (|2.7|) are described by fi = (fix, ■ ■ ■ , fx u ) G 
W(n, u), A = (Ai, . . . , X u ) G C(k, u) and ir = (ttx, • • • , irk) G ©(A) respectively. 

Proof. We proceed by induction on k. For k = 1 there is nothing to proof. Next suppose as 
induction hypothesis that (|2.6|) holds with fe — 1 instead of k. It gives 

fe— 1 n 

EE EE 7r ( a w>---> a vj®E :c j 

w=l AeC(fc-l,u)/jeW(Ti,u) 7re6(A) j = l 

n fe— 1 

EE E EE vr(x Ml ,...,x M J®x r (2.8) 
j=l u =l \eC(k-l,u) neW(n,u) 7re6(A) 

Consider a term 7r(x Ml , . . . , x^^Xj of the sum above, that is, j G {1, . . . , n}, u G {1, . . . , k — 1}, 
A G C(fe — l,u), fi G W(n, u) and 7r G ©(A). If there is f3 G {l,...,u} with j = /^g 
then it corresponds to exact one summand in (|2.6[) associated with indices u = u, X = 
(Xx, • • • , Xp-x, Xp + 1, A^+i, . . . , Xu), fi = fi and ff = (ttx, ■ ■ ■ , iru-l, P)- I n the other case, that 
is, if j G (fJ-p-x, Hp) for an f3 G {1, . . . , u + 1} with the convention //q := and fi u +i = oo the 
term ir(x^ tl , . . . , x^ u )®Xj corresponds to a summand in (|2.6|) associated with indices u = u+1, 

X = (Xx,...,X f 3-i,l,Xf3,...,X u ), A = (Ml, • • • ,/ffl-l, j,M/3, ■ ■ ■ ,A*tt) and * = (TTI, . . . ,7Tfc_i, 

As the number of summands in both (|2.6|) and (|2.8|) is equal to n fe , the induction step fol- 
lows. □ 

In the following we collect some known facts about multivariate Bessel functions on the 
cone Tig, which will be needed later. The material is mainly taken from [5]. We also refer to 
0] and 0. 



(i>r'= 

i=l 
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2.3 Bessel functions on the cone U q 

Let Z\ denote the zonal polynomials, which are indexed by partitions A = (Ai > A2 > • • • > 
\ q ) E Nq (we write A > for short) and normalized such that 

tr(x) k = ]T Z x (x) V k E N ; 
|A|=fc 

see [1] for the construction of Z\ and further details. It is well known that the Z\ are 
homogeneous polynomials which are invariant under conjugation by and thus depend 
only on the eigenvalues of their argument. More precisely, for x E H g with eigenvalues 
£ = (fl,-- - ,Cq) G W, one has 

Z x (x) = C£(£) with a = 2 

where the C" are the Jacfc polynomials of index a in a suitable normalization (see [!],[§]). 
The Jack polynomials are homogeneous of degree |A| and symmetric in their arguments. 
Let a > be a fixed parameter. For partitions A = (Ai, . . . , X q ) we introduce the generalized 
Pochhammer symbol 

(^A = n(V--^-i)) (^c), 
j=i \ a / \ 3 

where (-)j denotes the usual Pochhammer symbol. For an index //EC satisfying (/u)? 7^ 
for all A > the matrix Bessel functions associated with the cone Tl q are defined as 0-^1 - 
hypergeometric series in terms of the Z\, namely 

W = E^^(4 (2.9) 
\>oW\ |A|! 

For a general background on matrix Bessel functions, the reader is referred to the fundamental 
article [6J. If q = 1, then II 9 = [0, oof and we have J„(a: 2 /4) = j /U _i(a;), where j K (z) = 
qFi(k + 1; — z 2 /4) is the modified Bessel function in one variable. 

2.4 Polynomials on M p 

Let p, g E N. For k = E Nq X? (a composition) we set |/c| := K ij an d -Rj(k) := 

X^=i K r/> i = Moreover, we write z K := Yiij^j 1 - Clearly, z K is a monomial of 

degree \k\. The spaces of polynomials and row-even polynomials are defined by 



P := span{x K : k E Ng x? }, 
P e := span$yX K : k E Nq X9 ,V i R(i) is even j 



respectively. 

We shall need the following observation: 

Lemma 2.3. Lei r E Tig, and k E iVo* 9 - TTien 

* r , K : M M -> 5, V rtK (z) := ({zr)'{zr)) K 

is an even polynomial of degree 2\k\. 

Proof. Since the product of two row-even polynomials is also a row-even polynomial, the 
proof follows easily by induction on n = \k\. □ 
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2.5 Radial measures on M p9 and their moments 

In this section we study radial measures on the space M . In particular, we derive asymptotic 
results for their moments as p — > oo. This results will play a key role in the proof of Theorem 
13. li We start with the definition of a radial measure on M p (? . 

Definition 2.4. A measure u p on M- PyQ is called radial if 

A(u p ) = u p V A G P , 

that is, if it is invariant under the action (jl.ip . In particular, for q = 1 a measure u p on R p 
is radial if it is invariant under rotations. 

Remark 2.5. It is well known that for each probability measure v G M^IIq) and a dimension 
p G N there is a unique radial probability measure v p £ ]\I 1 (M p 9 ) with ^ as its radial part, 
that is, tpp{v p ) = v- 

In order to study radial measures on M pq and their moments we need an analogue of a 
sphere in our higher rank setting. For an r G Tl q we define a sphere of radius r as the set 

^p,q = € M Pi ,j : Vx'x = r j . 

Clearly, is the orbit of the block matrix a T := (r 0)' G M p q according to the operation 

For simplicity of notation, we write instead of Spuj, where I q G R 9 * 9 denotes 
the identity matrix. In the case q = 1 we identify Ti p 1 with the Euclidean sphere of radius 
r G [0, oof. Moreover, let us denote by Up" the uniform distribution on a sphere ^ pq - 

One can easily show that a radial probability measure v p with its radial part v G M 1 (n g ) 
enables the decomposition 

^(•)=L U^ x X-)dv p {x) = [ U;{-)dv{r) G M l (M m ). (2.10) 

In the sense of Jewett [8], the formula above is an example of a decomposition of a measure 
(here u p ) according to so called orbital morphism (here ip p ). More precisely, <p p is an orbital 
mapping, that is a proper and open continuous surjection from M pq onto Tig. The mapping 
r h-> Up from IL^ to M 1 (M Pi g) is a recomposition of (p p which means that each U p is a 
probability measure on M P)( j with support equal to ip~ l {r) (here = £p i(3 ), and such that 
v v = Im Up p{x) dv p {x). 

- p,q 

Definition 2.6. Let Z be a Mp^-valued random variable with distribution [i G M 1 (Mp )9 )- 
We say that fi G M 1 (M P „) (or Z) admits a fc-th moment (k G N ) ^ Jm INI ^M 2 ) < °°> 
and define in this case the k-th moment of \x (or Z) by 

MM = M k (Z) = E (Z^ k ) G Mp^,^. 

Let / = {(ii,ji),---,(ik,jk)} with i Q G {l,...,p} and j a G {1, . . . , q} for a G {l,...,/c}. 
Then the 7-th component M k (Z)j of M k (Z) is given by 

M k (Z)i = E(Z iujl • . . . • Z ife)i J. 
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Moreover, for an k G Nq X<? with \k\ = k we set 

m K {n) := J z K dfi(z) G R, 

and call m K (fJ,) also the K-th moment of /i. 

In the following fi, denote the characteristic function of a probability measure \x on M P)(? , 
that is, 

= / exp(i (x, y))dn(y). 

- p,a 

Let k G N and k G Nq X9 with |/e| = A;. If \i admits a fc-th moment then we have 

m K (ji) = (-ipD K fi(x)\ x= o, (2.11) 
where D K is the differential operator 8 ^ • • • 5 ^ • 

11 12 O'^pq 

Here and subsequently, f p denotes a radial probability measure on M p (J with the cor- 
responding radial part v G M (II ? ) and X is a M„ g -valued random variable with radial 
distribution v p . 

In the next lemmas we explore the covariance structure of X and compute the asymptotic 
behaviour of the moments of v p for large dimensions p. 

Lemma 2.7. Let X = (Xy)jj 6e M p „-valued random variable with radial distribution v p G 
¥\M p ,q)- Then 

E(X) = and E {XjiX lk ) = 5 jJL E (X u X lk ) (2.12) 

Proof. For r G R\{0} let Mj r and Sij bepxp matrices produced by multiplying all elements 
of row j of the identity matrix by r and by exchanging row i and row j of the identity matrix 
respectively. As S{j is a symmetric involution on M p , we have Sij G O p . For r = ±1 the 
matrix Mj r is also orthogonal. By assumption, X and AX are identically distributed for 
any A G O p . Therefore, we have 

HS-V);, KU/, :.V); ; K(.V), ; . 

So the first equality in (|2.12p holds. 

Choose i, k G {1, . . . , g} and j, I G {1, . . . ,p} with j ^ I. We conclude from 



E {XjiXik) — E ((M 7i _iX)jj(Mj i _iX);/ c ) — Z E (XjiX; 



Ik) 



that E(XjiXik) = 0. We now turn to the case j = I. The transformation M p (? — >• M p <? , 
A i — ^ SijA, switches all matrix elements on row i with their counterparts on row j. Therefore, 
from radiality of Px = v p it follows that 



E (XjiXjk) = E {(S^iX)^ (S jA X) jk ) = E (X u X lk ) for i, k G {1, . . . , g}. 

□ 

Now let us denote by Xi the i-th row of X. According to the lemma above, we have 

Cov(xi, Xj) = dij ■ E(^i^i) =: T p G M q . 

Therefore, we obtain 

Cov(X) := Cov{vec(X')) = L p ®T p £ M q . p . 
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Lemma 2.8. The characteristic function for the uniform distribution Up on the sphere T, pq 
of radius r G U q is given by 

U;(z) = J M Q(zr)V)) , (z e M m ) (2.13) 

where [i = \ and is the Bessel function of index fx of Eq. 
Proof. Let r £U q . Consider the map 

T r : S Pj(? — > y i y yr. 

Since T r (Up q ) = Up", we get by substitution formula 

U;(z)=f e i ^dU;(y)=[ e^dU^y). 
j M M * Js P , q 

On the other side, according to Proposition XVI. 2. 3. of [4] we have for x G M Pi9 the identity 

By taking these two identities above into account, (|2. 13|) follows as claimed. □ 

Lemma 2.9. Let k G -/Vq X<? , I := |k|/2 and /u = |. The K-th moment m K (Up) of the uniform 
distribution on is given as follows: 

(a) If Ri{n) = J2j=i K ij even for all i = 1, . . . ,p, then I G N and 

I ^ _1 

AeC (Z,g) (m)a 



m ^ ) = ¥ki! S 7T^^(^(^^))| 2= o- (2 - 14) 



If Ri{n) is not even for some i = 1, . . . ,p, then m K (U p ) = 0. 
Proof. By the Identity (|2.11|) . the preceding lemma and (|2.9|) we have 



-^;) = H) N E i # E -4ij.WJwv))) . (2.i5) 

Let A G Nq and p r : z ^ Z\ ((zr)*(zr)). Since Z\ is a homogeneous polynomial of degree |A|, 
Lemma 12.31 shows that p r is a homogeneous, row-even polynomial of degree 2 |A|. Therefore, 
each term on the right-hand side of (|2,15p vanishes if k G Nq X<? with is odd for some 

i G {1, . . . ,p} or if |k| 7^ 2 |A|. This proves the assertion. □ 

Theorem 2.10. Let k G I% xq , I := \k\/2, v G ^(IL,) and u p G ^f 1 (M p q ) be the correspond- 
ing radial probability measure on M pq which admits a K-th order moment. Then the K-th 
moment m K {u p ) of u p exists in R and has the following asymptotic as p — > 00: 

(a) If Ri{k) is even for all i = 1, . . . ,p, then m K (u p ) = O C^jj . 

(b) If Ri{k) is not even for some i = 1, . . . ,p, then m K (v p ) = 0. 
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Proof. The existence of m K (v p ) is clear. By the decomposition (|2.1Up we obtain 

m K {u p ) = \ m K (Up)du(r), 



where Up is the uniform distribution on Ep, g - Therefore, the assertion (b) follows immediately 
from Lemma 12.91 (a). Now we turn to the case (a). Since the A-th term in the sum (|2.14p 
is a homogeneous polynomial in the variable rn,ri2, • • • ,r qq of degree 2|A| which is also 
independent of p, Lemma 12.91 (a) leads to 

E ,/ n .°(?) d "M = (?)' 



Aec (/,<?) 



□ 



2.6 Matrix variate normal distribution and their moments 

In this section we derive some results concerning the class of matrix variate normal distribu- 
tion on M , to which belongs the limiting distribution in our main result [L~2l 

Let Z = (zij)i<i j<q be a real matrix variate normal distributed variable with mean 
matrix [i £ M„ and symmetric covariance matrix 

S = (%,),(^))i< m m< ,= ( S (W,(m))i< m ^<^ M g2 - M q ® M g . (2.16) 

We write Z ~ N(/x, £) for short. This means that vec(Z') is N(vec(//), Undistributed. In 
order to prove some formulas for moments Mk(Z) = E(Z® fc ) of Z, which we will use in 
Section we need the following notation. Let u G N, k := 2u, I = ■ ■ ■ , (ik,jk)) £ 

({l,...,q} 2 ) k , A = (2,..., 2) 6 C{k,u) and vr = (tti, . . . , vr fe ) e 6(A). For a tuple u = 
(vi, . . . , u n ) we will write {u} instead of the set {v\, . . . , v n }. Consider the sets 

TrODi = {(Wm) g i J } : 7r ^ = i i («' = 1, •••,«)• 

Obviously 7r(/)j (i = 1, . . . ,u) forms a partition of {/} with |7r(/)j| = 2. We define for ir, I 
and a symmetric covariance matrix £ as in (|2.16|) . 

u 

: = Il S K,ft),(7„5,) where (7i,^)} =7r(i")i- 

i=l 

For instance let u = 2, J = {(2, 1), (2, 2), (3, 2), (2, 1)} , A := (2,2) G C(4,2) and vr = 
(12 12) =: (7Ti...7r 4 ); then we have tt(J)i = {(2, 1), (3, 2)}, 7r(I) 2 = {(2, 2), (2, 1)} and 

7r(£)j = £(2,1), (3,2) • £(2,2), (2,1)- 

The moment formulas Mk{Z) for multivariate normal distributed random vector Z ~ 
N(/U, £) are well studied in the literature (see [12] and [S]). In |12[ Theorem 1] we find 
moment formulas for centered Gaussian distribution Z, which are derived in a relative fast 
and elegant way. This formula can be easily translated in our setting. Namely, the 7-th 
component of &;-th order moment of a N(0, £)-distributed random matrix Z is given by 

{0, if k is odd, 

£ £ ttCE)/, iffc = 2«,A = (2,...,2)€C(M). ^ 
' 7re6(A) 
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In the most classical case q = 1 , that is, Z is centered Gaussian distribution on R with 
variance a 2 > the identity (|2.17p reduces to the well known formula 



■ 0, if k is odd, 

E(Z k ) = { ' ' (2.18) 

o (k — l)(k — 3) • . . . • 3 • 1 if is even. 



The following two simple observations concerning the A;-th moment of normal distributed 
random matrix and a sum of two independent, normal distributed random matrices respec- 
tively will be needed for the proof of Theorem 13.11 

Lemma 2.11. Let Z be ./y(0,X)- distributed random, variable and Zi,Z2, ... independent 
copies of Z. The k-th order moment of Z is given by 



M k {Z) -- 
where A = (2, ... ,2) G C(2u,u). 



0, if k is odd, 

% E Eir(Z u ...,Z u ), ifk = 2u 

' tt66(A) 



Proof. Let k G N and I = ((h,ji), ■ ■ ■ , (ik,jk)) £ ({L • • • > l} 2 ) k - If k is odd, then it follows 
by (pTTD that M k {Z)i = 0. Suppose that k = 2u, (u e N). For vr G 6(A), A = (2, . . . , 2) G 
C(k, u) and I as above, we have vr(Zi, . . . , Z u )j = (Z ni (g) . . . <g) Z nk )j. Let {(ctj, /3j), (74, <5j)} = 
i = 1, . . . ,u. By independence it follows 

Ett(Zi, . . . , Z u )j = E(Z m ® . . . ® Z ff Ji = J] E(Z< 8) ^ , A) 

= n s («i.A).(7iA) =7r ( s )^- 

i=l 

The lemma is now a consequence of Eq. (|2.17p . □ 

Lemma 2.12. Let Zj (i = 1, 2) be independent random variables with distributions Jy(0, 
Then 

k 

E({Z 1 + Z 2 f' k )=J2 E ^(^,1)0^(1,^2). (2.19) 

1=0 nee((i,k-i)) 

Proof. By the definition of o-product and independence of Z\ and Z<i we have 

k 

E((Z 1 + Z 2 )®> k ) = E E Ett(2i,3j) 

Z=0 7reS((Z,fc-0) 

= E E E (7r(Zi, l) o 7r(l, Z 2 )) 
Z=0 7reS((i,fc-i)) 

= E E E7r(Zi,i)oE7r(i,Z 2 ). 

Z=0 7re©((i,fc-0) 

□ 
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3 Radial limit theorems on M„ „ for p — > oo 

Let v G ]\l 1 (n g ) be a fixed probability measure such that / n ||:r|| 4 dv(x) < oo. Then for each 
dimension p £ N there is a unique radial probability measure u p S 1^1 (M„ 9 ) with v as its 
radial part, that is, v = ip p {y p ). Let X = (xij)ij be u p distributed random matrix on M. pq . 
We define 

r 2 {v) :=E(^(X)) =p-T p GU q , 

E(»/) := Cot(^(X)) = Ccw(i;ec(^(X) / )) G Il^a n g ® n g . 

Clearly, ^(f) and are independent from p. Now, we consider for each p € N i.i.d. 

M P)(J -valued random variables 



X fc := (xi iJ) ) , fc e N 

V fc / l<i<p, l<j<q 



with law u p as well as the random variables 

:= v p {Si) 2 - nr 2 (u), (3.1) 

where := J2k=i-^-k- Let (p n ) ng N C N be a sequence with lim n _ J . OC) £> n = oo. In this 
section, we derive the following two complementary CLTs for M -valued random variables 
^niy) '■= "n n (^) un der disjoint growth conditions for the dimensions p n . 

Theorem 3.1. Assume that v € ^(Hq) admits finite fourth moment. 



/Pn 

n 

normal distribution ]Sf(0,T(f)) with covariance matrix T{v) := T\{v) + T 2 (v) where 



CLT I: If lim — = oo, then ^—^ -E n (u) tends in distribution to the centered matrix variate 



Ti{v)^j)Xk,l)=r2{v)i,kr2{v)jj and T 2 (u)^ j )^i) = r 2 (v) i: ir 2 (v)^ k . (3.2) 

CLT II: If lim — = c£ [0, oof, then A= -zi„(i>) tends in distribution to the centered matrix 
variate normal distribution $(0, + cT(v)) (where T{y) is given as in CLT I.) 

Notice that for q = 1 we obviously have v G I^I 1 ([0, oo[), r 2 (y~) = x 2 du(x), T(v) = 
2r 2 (u) 2 and T>(y) = x^dv(x) — r 2 (u) 2 . Therefore, Theorem 13.11 completely agrees with 
Theorem II. H 

The proof of Theorem 13.11 will be divided into two main steps: In the first step we prove 
a reduced form of Theorem 13.11 assuming that v has a compact support. In the second step 
we will show how to get rid of the support condition for v. Both steps are based on the 
decomposition of z> n {v) via 



3t«(f) :=I>i, with At :=ip Pn {Xif -r 2 (v), (3.3) 

i=i 

Pn 

and <B n (v):=J2B i: with fl f := V \x^xf l) ] (3.4) 



i=l a,/3=l,...,n; 
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We compute the covariance structure of 2l n (f) and Q5 n (f ) respectively: Since the random 
variables A4 (i = 1,2,.. .) are independent and identically distributed, it is easily seen that 

E(A k ) = 0, Cov(Ai,Aj) = SijH(u). (3.5) 

This gives 

1 1 n 

-Cov{% n {v)) = -Y j Cov(A k ) = (3.6) 
n n 

k=l 

By the independence of random variables X k , k G N and Lemma 12.71 we obtain 

Tl\Tl — 1 I 

E(S fc ) = 0, CoviB^Bj) = Sij 1 2 - T(v). (3.7) 

Pn 

We thus get 

Pn 

lim ^Cov^Ju)) = lim C<w(5i) = T(zA (3.8) 

i=l 

In the following we will establish convergence in distribution of the random variables 2l n (f) 
and ^& n {v) (after appropriate scaling) by the method of moments [3, Theorem 30.2], which 
can be easily adapted to our general situation. As we are sure that the result is well-known, 
we omit the proof. 

Theorem 3.2 (Method of moments). Let Y,Yi,Y%,... be M valued random variables. 
Suppose that the distribution ofY is determined by its moments M k (Y) {k G N), that the Y n 
have moments M k (Y n ) of all orders, and that 

lim M k (Y n ) = M k (Y) 

n—>oo 

for k = 1, 2, .... Then the sequence (Y n ) n converges to Y in distribution. 

Remark 3.3. Each matrix variate normal distribution ^(M, £) on M„ „ or distribution with 
compact support are determined by its moments. 

Definition 3.4. Let (D n ) (d n ) n ^ be a sequences of matrices from M q and positive 
real numbers respectively. We write D n = 0(d n ) as n — > 00, if and only if ||-D n ||oo = 0(d n ) 
as n — > 00. 

Proposition 3.5. Assume that v G fyt (Hq) has compact support. Then the asymptotic 
behaviour o/2l n := 2t n (i / ) is given as follows: 

(a) If — >c£ [0, oof asn-> oo, then "^2ln tends in distribution to ^(0, £(z/)). 

(b) If — > 00 as n — )■ 00, i/ien ^^-^i n tends in distribution to 5q. 
Proof. If we prove that for all fc£N , the &-th order moments 




tend to the fc-th order moment of the corresponding limit distribution in the case (a) and 
(b) respectively, the assertion follows by the method of moments 13.21 Therefore, we calculate 
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(|3.9p as n — > oo. Since the random variables Aj are identically distributed, Theorem 12.21 
shows that 



E(2l®' fe 



u=i\eC(k,u) \ / 7re6(A) 



■ \eC(k,u) \ / 7rS6(A) 

For u € {1, . . . , A;} and AG C(fe, we consider 



T(A) := ( ] E Ett^!,...,^) £M,, (3.10) 

W 7re6(A) 



5(A) 

If A Q = 1 for some a, i.e A a appears exactly once in tt(Ai, . . . ,A U ), then each summand 
in (|3.10p vanishes, which is due to the facts that E(A a ) = G M and that the Ai are 
independent. 

Suppose that X a > 2 for each a and A a > 2 for some a. Then k > 2u, and since 
T(A) = 0{n u ) as n ^ oo, it follows that (l/n fc / 2 ) • T(A) and {p k n ,2 /n k ) ■ T(A) in the cases 
n /Pn — > c G [0, oof and n/p n — > oo respectively tend to zero as n — > oo. 

Now we turn to the case A = (2, . . . , 2), in particular k = 2u. Let Z±, . . . , Z u be indepen- 
dent and N(0,£ 2 (z^)) distributed random variables. By Lemma l2.lt f° r an y n £ there 
exist permutation matrices P n and Q,,- with 

P 7r E(vr( J 4i, . . . , A u ))g,r = E(Ai ® ® . . . ® 4 U A u )= tg> . . . <g> T,(v) 

= B(Zi ® Zi ® . . . ® Z u ® Z u )= P 7r E( 7 r(Zi, . . . , Z„))Q W , 

and hence 

Evr^!, . . . , A u ) = En(Zx, . . . , Z u ) V vr G 6(A). 
Therefore, according to the Lemma 12.111 we have 

T ( A )=f n l E E(vr(Z 1 ,...,Z u ))= r ^-M fc (Z 1 ). 

This proves that the moments in (|3.9|) converge to those of N(0, £ 2 (i/)) and the Dirac distri- 
bution do respectively. □ 

Now we introduce some notation: Let k, n G N and \ kn the set of all 2/c-tuples j%, . . . ,ik, 
of positive integers less or equal n such that i a ^ j a for all a = 1, . . . , k. For an / G \ k n and 
7r = (tti, . . . , ir k ) G N fc we set 



S(i» := x ( " 1 ' ai) X ( " lA) ®...® xf fe '" w Xr fc ' w . (3.11 



.71 



1<qiA<9 



l<«feA-<9 



Each entry of S(I, tt) G M g fc is a product with A; factors and corresponds to the tuple 

((zi,7Tl,Q!l), (il,7Ti,/?i), . . . , (i k ,7T k ,a k ), (jfc , 7Tfc, /3fc)) . (3-12) 

For (|3,12[) and two integers a, b we define 

multi Ja,b) = \{t G {1, . . . , k} : (i T ,ir T ,a T ) = (a,b,a T ) or (j T ,vr r ,/3 T ) = (a, 6,/3 T )}| . 
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It is clear that multi n (a, b) does not depend on the indices a T and (3 T . Therefore, multi ^(a, b) 
is the number of factors in an arbitrary entry of the matrix S(I, tt) which are coming from 
the 6-th row of X a . Moreover, we write d{I) for the number of distinct elements in {/}. For 
an m G {2, . . . , 2k} and M5{l,...,n} with \M\ < k we consider following subsets of \ kn 



im 


= G lk,n ■ 


d{I) 


= m| , 






{I} = 


{1, . . . ,m}} , 


Jl(M) 


= {/ E J 2 U . 


■•u J* 


: {/} n M + 0} , 


il(M) 


= {I G J 2 U . 


• • u J fc 


: m G {J} V m 6 M} 


J°(vr) 


= f J € I fejn : 


3 a, 


6 G N : mult] t7T (a, b) is 



It is easily checked that for the cardinalities of J m , j|(M) and J k (M) we have 

|JJ < Cn m , \f k (M)\ < Cn k -\ |^(M)| < Cn fe -I M I (3.13) 
with some constant C = C(k). 

Proposition 3.6. Assume that v G (II g ) /ias compact support. Then the asymptotic 
behaviour of^B n := *B n (i>) is given as follows: 

(a) If ^ — ^ as n - t- oo, then -^53n tends in distribution to So. 

(b) If ^- — > c G]0, oo] as n -> oo, i/ien (^^Q *Bn terete m distribution to the normal 
distribution $(0,T(v)). 



Proof. According to the Theorem 



it suffices to show that the k-th. moments of -7=23*, and 

^^■5S n tend to the corresponding ones of the limiting distributions as n — > oo. By using very 
similar arguments as in the proof of the Lemma [2 .71 it is easily seen that Bi (i = 1, 2, . . .) are 
identically distributed. From this and Theorem 12.21 we conclude 



For an v G {1, ... , k}, A G C(k, v) and tt G &(fj) we consider n(Bi, . . . , B v ) 
of B a (a G M„) in (|3.4p enables us to write 



7r(Bi, . .. = jB^ ® . .. ® jB. 



E sc.*). 



The definition 



(3.14) 



where each term S(I,tt) with / = ji, . . . ,ik,jk) is given by (|3.1ip . For a selected index 
a G M n , each entry of S(I, tt) may be regarded as a monomial in the variables X a (that is, in 
xi a '^ with a, /3 G N) while the random variables coming from other indices are considered 
as constant. In this view, for any / G J°("7r), each entry of S(I, tt) is for some a G {1, . . . , n} 
and b G {1, . . . , v} a monomial in the variable X a which is not even in row b. And hence 
Theorem I2.1UI clearly forces 



E(5(i») = VJgJ°(tt). 



(3.15) 
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Therefore, since J m C J (tt) for m > k, we conclude from (|3.14|) that 

k 

Eir(B 1 ,...,B v )=J2 E ES(i». (3.16) 
m=2 izim 

By the definition of S(I, it) in (|3.11|) and Theorem I2.1UI the terms in the last sum are 
uniformly bounded by C ■ n m with a constant C > 0, that is, 

sup \\ES(I,*)\\ 00 = 0(n m ). 
Moreover, according to (|3.13|) we have |J m | < Cn m for a constant C > 0, and hence we get 
En(B 1 ,...,B v ) = £ ES(I,7r) + o(lC)=o(iy (3.17) 

For v E {1, . . . , k} and fi £ C(k, v) let us consider 

nM):=r*J E Ett^i,...,^). (3.18) 

If fi a = 1 for some a, i.e for any 7r G S(/i) the factor B a appears exactly once in 
the product tt{B\, . . . , B v ) , and therefore, each I £ \ kn from the Representation (|3.14|) of 
tt(Bi, . . . , B v ) is necessarily from J°(7r), and hence (|3.15|) gives T(p) = 0. 

Suppose that fi a > 2 for each a and fi a > 2 for some a, that is, in particular k > 2v. 
From ([3TT71) we conclude that n~ k l 2 T{^) = 0(n k / 2 p^ k ) and p^ 2 rT k T (ii) = 0(p v n ~ k/2 ) tend 
to as n — > oo in the case (a) ^ — >• and case (b) ^ — >• respectively. 

We now turn to the case fi = (2, . . . , 2), in particular = 2i>. By Eq. (|3.17p it follows 
in the case (a) that n~ v T([i) = 0((n/p n ) k ~ v ) and hence that n~ u T(/x) converges to zero as 
n — > oo. 

Since X\, X2, ■ ■ ■ are i.i.d., we have 



£ES(/,7r)=fr) EES(/,vr) 



Therefore, by using Eq. (|3.17p . 



p n \ n! 1 ^ lrf 
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k-l 



w (Pn-«)!(n-fc)!«! ^ p*k\ ^ ~ y ' \ p k -v) 

Let Zi, . . . , Z v be independent and r>!(0, T(v)) distributed random variables. By Lemma [3T71 
which is proven below, we obtain 

lim P \ T ^) = - EAZi,...,Z v ). 

n— >oa fi K y\ L — ' 

' 7T6©(/<) 

The required result then follows from Lemma 12.111 and Method of moments 13.21 □ 
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Lemma 3.7. Let v G N, k = 2v, n= (2,..., 2) G C{k,v), ir G and Z\, . . . , Z v be 

independent 1^(0, T(v)) distributed random variables. Then 

Bx(Z 1 ,...,Z v ) = ^ £ ES{I^) =:R(tt). 

Proof. According to the Lemma 12.11 there is no loss of generality in assuming that ir = 
(1, 1,2,2, ... ,v,v). We set 

Jjfc.TT : = {(h,jl,---,h,jk) G J fc : {ia,3a} = {ipjp} i^a = ^p}- 

It is easy to check that J fc \ J fc 7r C J°(vr). Therefore, by Eq. (|3.15|) . 

X; E5(J,tt)= X E5(J,7r). 

For a permutation a £ Sj. := Sym({l, . . . , k}) and e = (si, . . . ,e u ) G Z2 we consider the 
functions 

¥V :Jfc j7 r — ► Jjfc )7 r> • • -,ikdk) ^ (o"(*l),o"0'i), • • • ,o-(ik),o-(jk)) 

°e -h,n — > Jit.Tr) • • -,h,jk) 0*i,ti, • • - ,rfc,tfc), 

where (n, ti, . . . , r/.,ti~) is defined as follows: for any a, /3 G with a < (3 and 7r Q = 7T0 G 
{1, . . . ,v} we have 

{ia,3a,ip,jp), if £7r Q = 0, 

(ia,ja,jp,ip), if £7r a = !• 



(r a ,t a ,rp,tp) 



It is easily seen that </? CT and £ are well defined. Let Jo := (L 2, 1, 2, ... , fc— 1, k, k—1, k) G J fc 
By standard verification we obtain a one-to-one correspondence between S/- x Z2 and ^ k7T via 
the map $ : (a,e) i-)- </v(0 e (io))- Since Xl,X2,... are independent identically distributed 
we have for all a £ Sk 

ES(ifM)^) = ES(I,ir) Vl€j fc _. (3.19) 



For an e G Z 2 we consider the algebraic operation 

e(a, 6) : 



a, if e = 0, 
6, ife = l. 



By Equation (|3,19p it follows that 



(cr,e)eS fc xZ2 ^sZ^ 
= ]T £l(7l,T 2 )® ...®£„(Ti,r 2 ) = E7r(Zi,...,Z„), 

Zv 
--2 

where T\ := T\{v) and T 2 := T 2 (^) are defined as in (|3.2|) . □ 
Now, in order to prove Theorem 13.11 for sequences p n with p n /n — > c G]0, oo[ we show 
that 2t n := 2l n (z^) and *B„ := 53 n(y) are asymptotically independent. 
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Proposition 3.8. Assume that v G MVlL) has compact support and that lim — =: c G 
]0, oo[. T/ien i/te random variables 2l n and 23 n are asymptotically independent, that is, for 
allO < I <k and all a G 6((Z, fc - /)) 

F(n; a) := [£o-(2l n , l) o Ea(t, <B n ) - £<t(21„, ©„)] 
tends to zero as n -> oo. 

Proof. According to the Lemma 12.11 there is no loss of generality in assuming that a = 
(1, ... 1,2, ... , 2). From Theorem 12. 21 by using symmetry argument, we conclude 



s^E E (:)( P ;) E E 

u=i «=l Aeca.u) ueC(k-l,v) \ J \ / 7re6(A) Tr'ee(u) 



u=i t;=l AeC(«,u) fj,eC(k-l,v) \ / \ / 7re6(A) 7r'e6(/i) 
with 

fr(7r, tt') = Ett(Ai, . . . , A u ) ® Ett'^x, . . . , B„) - E(tt(Ai, . . . , A u ) ® tt'^, . . . , 

If /x Q = 1 for some a G {1, ...,«}, then each entry of n'(Bi, . . . , B v ) is not an even 
polynomial and thus so is tt(Ai, . . . , A u ) (g> tv'(Bi, . . . , S^) neither. Therefore, -ff(vr, 7r') = 
by Theorem 12. 101 

Suppose that \x a > 2 for each a. By Eq. (|3.16|) we have 

H(7t,tt')= J2 (Ev^(^l,...,A ^1 )®E5(I,7^ , )-E(v^(A 1 ,...,^)®5(I,7^ , ))). 

/6j 2 U...uJ fc _, 

(3.20) 

Let M := {1, ...,«} and G := {a G M : A Q = 1}. We consider the I-th term in the sum 
above, which will be denoted by T(I). Is I £ j|_ z (Af), that is, {1} n M = 0, and thus 
A±, ... ,A U are independent from S(I,ir'). This clearly forces T(I) = 0. Is I £ ^X_i(G), that 
is, there exists r G G with r ^ {/}, and therefore, A T is independent from A{ {i G M \ {t}) 
and 5(7, vr'). We thus get T(I) = from (133]) . 

Taking (|3.13|) into account, we see that the number of nonzero summands in (|3.2U[) is 
bounded above min(n fc_ ' _1 , n fc_ '~' G '). On the other side, Lemma 12.101 yields that each of 
them is bounded above C/p^ 1 where C > is a suitable global constant. Summarized we 
get 

||#(7r,7r')|| < C-min(n _1 ,n-l G l). (3.21) 

Since fi G C{k — l,v) with fj, a > 2 for all a G {1, • • • , v} we have that k — I > 2v. Moreover, 
since A G C(l,u) we get I > 2u — \G\. And hence, by straightforward calculation using 
n/pn c G]0, oo[ we conclude from (|3.21|) that for suitable constants C$, 

'n\lp n \ . / -i —\G\\ 
mm(n , n 1 ') 

\ec(i,u) nec(k-i,v) 

s^EE E «" + »mi„ (n -',„-'°')<^. 
n u =i v=i \ec(i,u) v 

This completes the proof. □ 



e e (;;) 

u=l ij=1 AeCtf.u) aeCWs-J.tj) \ / 
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Proof of Theorem 1 3. 1\ for u G fyl (H q ) with compact support. 

If n/p n — > co then -^-2l n -4 5o and ^5B„ -4- rST(0, T(u)) according to Propositions 13.51 
and 13.61 This clearly forces ^^E„(i/) -4 rj"(0,T(^)) by Slutsky's Theorem. Suppose that 
n /Pn ~~ ^ 0. Then we get as above -4 rJ(0,£(V)). It remains only to check the 

convergence in the case n/p n — > c G]0, oo[. Let k G N. By Theorem 1 2. 2 [ 

fc 

il4(S n (y)) = E ((2l n + <B n f fc ) =J2 E Evr(2t n ,5S n ). 

i=0 7r66((J,fc-Q) 

Therefore, by Proposition 13.81 

1 1 

lim M fc (— S n (i/))= lim V V E7r(2l„,i)oE7r(l,«8 n ). 

V 1=0 n£&((l,k-l)) 

Consider independent random variables Z\, Z2 and Z with distributions 1^(0, ]NT(0, cT(z/)) 

and r^(0,S(^) + cT(v)) respectively. Propositions 13.5 1 13.61 and Lemma 12.121 now lead to 

fc 

lim M k (E n (u)) = V V Evr(Z 1 , l) o Ett(1, Z 2 ) = M k (Z). 

n— >oo — » * — ' 

/=0 7re6((/,fc-/)) 

□ 

In order to get rid of the assumption that supp{v) is compact, we introduce for an a > 
the truncated M„ .-valued random variables 

— Pn,y 

X Ka :=[ Xk ' if ll^™il<«, fe = 1]2) ... 
I 0, otherwise 

Let us denote by v a the distribution of 9? Pn (Xi ja ) (which is not dependent on p n ). Obviously, 
the sequence X k ^ a , k G N, are i.i.d. with the radial law fp n , a G M(M Pni9 ) which corresponds to 
v a . We define S n (z/ a ), 2l„(i/ a ), Aj j0 (j = 1, ... ,n), <B n (f a ) and (j = 1, . . . ,p n ) according 
to (|3.ip . (|3.3|) and (|3.4|) respectively, by taking X kA instead of X k , k G N. Clearly, we have 

S„(z^ a ) = 2l n (z^ a ) + <8 n (f )- 

In the following we show that H n (f a ) is a "good" approximation of H n (z/). To formulate 
this exactly, we first fix some 5 > and a sequence (p n )n', we then introduce the sequence 
(5 n )n by 

ftf- V". if f^ce [o,oo[, 

S n ■= < Pn 3.22 



In the next lemmas we show that the events 

{\\%n{u a ) - 2l n (i/)|| > S n } and {||<B„K) - «8„(i/)|| > <U 
have arbitrary small probabilities for an a and n large enough. 

Lemma 3.9. For all e > 0, 5 > i/iere exfst ao, n$ £ N such that for all n, a G N with 
a > ao a^rf re > no 

P(||2l n H-2l n (z, a )|| >5 n ) <e. 
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Proof. Let 5 > and (5 n ) n be a sequence as in (|3.22p . Since (A4 — Ai )a ), (i = 1, 2, . . .) are 
i.i.d., it follows by Chebychev inequality that 



p (iisi^z/) - 2t„K)|| > <y < -e - ^i.all 2 ) • 

Using triangle inequality we obtain 



(3.23) 



sup p 1>a f < ( ^ Pn {X x ) +\\r 2 (y)\\) a 1 ^), 

Therefore, the set {||^4i ia || 2 : a E N} is uniformly integrable. On the other side, since the 
random variable \\Ai\\ is almost surely finite, ||Ai )CI || 2 converges a.s. to ||^4i|| 2 as a — > 00. We 
thus get 



\\M,a\ 



Pill in^ 1 - 



By taking (|3.23p and (|3.24p into account, the lemma follows. 



(3.24) 
□ 



Lemma 3.10. For all e > 0, 5 > there exist ao, uq E N such that for all n, a G N with 
a > ao and n > uq 

P(||» n (i/)-»„(i/ a )|| >S n ) <e. 

Proof. Let 5 > and (<5 n ) n be a sequence as in (|3.22|) . By Chebychev inequality it follows 
that 

p(ll» n (i/) - »„(!/«) 11 > < T2 E - ^> B ; - ^» • ( 3 - 25 ) 

Using Lemma 12.71 one can easily compute that 

'Thf JT, ^ 

E((Bi,Bj)) = Sij ^ r 2( u )i,i r 2( u )k,k + r2(v)i,kr2(v)i,k 

Pn i,k=i 

E((5 iia ,5 jia )) = g E r 2(v a )i,ir2(v a )k,k + r2{y a )i,kr%{va)i,k 



Pi, 



Lk=l 



With the notation 



we see at once that 



Ha;n) := f E f 



l<l,k<q 



E((Bi,Bj >a }) = 5 ij n{n-l) ^ f 2 (a; n\if 2 {a; n) fe)fc + r 2 (a-,n)i tk r 2 (ri; a)i tk . 

Lk=l 



For Z, A; G {1, . . . , q} we obtain 



1 



f 2 {a]n)i k = —r 2 {v)i )k 

Pn 



X^X^dP. 



'{||^ill>4 

By Cauchy-Schwarz inequality and straightforward calculation we get 



(3.26) 



< 



{||*i||>a} 



< , a — > 00 

ap n 
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uniformly in n with some constant c > 0. From this and (|3.26|) we deduce 



and hence 



p„f 2 (a;n) = r 2 (V) + O ( - 

,a 



Ve>03M>0Vn>M, Va>M: < (llBi - B ia ||) < e. 



Finally, this and (|3.25p lead to the claim. 



□ 



Corollary 3.11. For all e > 0, 5 > there exist ao, Uq € N such that for all n, a E N with 
a > ao and n > uq 

P(||5 n (i/)-5 n (i/ a )|| ><5 n ) <e, 
where 6 n = 5yjn ifn/p n ->c£ [0,oo[ and = 8-J== ifn/p n — > oo. 



Proof. For an 5 > we observe 

P (||H n ^) - S n (^)|| > S n ) < P(||2l n - 2l n , a || > Jl)+P(||«8 n - «8„, B || > y). 
Combining this with Lemmas 13,91 and l3.1Ul the corollary follows. 



□ 



Proof of Theorem \3.1[ 

/p~ 

Let us first prove the CLT I. In this case the normalisation is given by and for the 
growth of p n we have the condition n/p n — > oo as n — > oo. We set £ n := ^-^E n (v) and 
(u a ) and denote their distributions by \x n and fj, n>a respectively. Moreover, we 
write t v instead of rj(0, T{u)). Using triangle inequality, we deduce that 



J fdfln - J fdT v < J fdfJL n - J /d/i n , 



+ 



(3.27) 



+ 



J fdp, n ,a ~ J fdr Ua + J fdr Ua - J fdr u 



Let e > 0, / 6 C^(n g ) be a bounded uniformly continuous function on Ii q and As := 
{Un ~ U,a\\ <$} (5 > 0). It follows that 

3<5>0: / \foCn-foCn,a\dP<e. 
On the other hand, by Corollary 13.111 

3 o , n > : / |/ o £ n - f o £ n o | dP < 2e ||/|| V a > o , n > n . 
./fi\.A 4 

This gives us the following estimation for the first summand in (|3.27l) : 

3 a , n > : \J fdfi n - J /d// n , a | < e(l + 2 H/HJ V a > a , n > n . (3.28) 
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Since v a has a compact support, we conclude from 13.11 that fj, n>a weakly converges to r Va 
(a > 0), hence that 

Va>03n >0: J fd^ a - J fdr Ua <e V n > n . (3.29) 

Finally, it is evident that 

3 a > : J fdr Ua - J fdr u <e V a > a . (3.30) 

Taking (|3.28|) . (|3.29p and (|3.3Up into account, we obtain 

3 n > : \j fdu n - J fdr v \ <e(3 + 2 ||/||J V n > n , 

which completes the proof of CLT I in Theorem 13.11 The same proof works for CLT II. □ 
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